Skip to content

Fix ARQ stale result blocking ingestion requeues#400

Merged
ArnavAgrawal03 merged 1 commit into
00bad53466from
fix/arq-clear-stale-results
May 11, 2026
Merged

Fix ARQ stale result blocking ingestion requeues#400
ArnavAgrawal03 merged 1 commit into
00bad53466from
fix/arq-clear-stale-results

Conversation

@ArnavAgrawal03

Copy link
Copy Markdown
Collaborator

Summary:

  • Add a shared ARQ enqueue helper that removes stale completed-result keys for stable ingestion job IDs before enqueueing.
  • Use the helper for standard ingestion, update-file ingestion, v2 ingestion, and admin requeue paths.
  • Add unit coverage for stale-result clearing, duplicate preservation, delete failure handling, and no-job-id behavior.

Tests:

  • uv run pytest core/tests/unit/test_arq_jobs.py -q
  • uv run python -m py_compile core/utils/arq_jobs.py core/services/ingestion_service.py core/services/v2_document_service.py core/routes/ingest.py

@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.


Ubuntu seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

@ArnavAgrawal03 ArnavAgrawal03 merged commit 3984038 into 00bad53466 May 11, 2026
2 of 4 checks passed
@ArnavAgrawal03 ArnavAgrawal03 deleted the fix/arq-clear-stale-results branch May 11, 2026 01:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants